============ Initialized logger ============
add_traspose_rels: True
aggregate: pna
aug: False
batch_size: 32
constrained_neg_prob: 0.0
dataset: nell_v4
dropout: 0.2
early_stop: 50
emb_dim: 32
enclosing_sub_graph: False
exp_dir: GNN/experiments/nell_v4_fi
experiment_name: nell_v4_fi
gpu: 5
hop: 3
l2: 0.0001
load_model: False
loss: bce
lr: 0.0005
main_dir: GNN
margin: 10
max_links: 1000000
message: gru
num_epochs: 10
num_gcn_layers: 4
num_neg_samples_per_link: 1
num_workers: 8
optimizer: Adam
residual: False
train_file: train
un_hop: 1
update: lstm
using_jk: False
valid_file: valid
============================================
No existing model found. Initializing new model..
Device: cuda
Input dim : 32, # Relations : 152
Total number of parameters: 145025
Starting training ...
====================================================================================================
Epoch 1 Training Performance:{'auc': 0.8197713446405821, 'auc_pr': 0.7924048656215337, 'acc': 0.7204479194275113} in 586.1225926876068 s 
Epoch 1 Validation Performance:{'auc': 0.846625383123788, 'auc_pr': 0.8273057327853515, 'acc': 0.6187214611872146} in 39.07908010482788 s 
Epoch 1 Better models found w.r.t AUC-PR. Saved it!
Epoch 1 with loss: 0.5176770747718165, best validation AUC-PR: 0.8273057327853515, weight_norm: 13.311975479125977 in 625.262101650238 s 
====================================================================================================
Epoch 2 Training Performance:{'auc': 0.8865996216227722, 'auc_pr': 0.8727353620170446, 'acc': 0.7907500662602703} in 595.1154232025146 s 
Epoch 2 Validation Performance:{'auc': 0.8854414263672568, 'auc_pr': 0.8663277737883657, 'acc': 0.6763698630136986} in 38.98332166671753 s 
Epoch 2 Better models found w.r.t AUC-PR. Saved it!
Epoch 2 with loss: 0.4210987841173754, best validation AUC-PR: 0.8663277737883657, weight_norm: 12.43718433380127 in 634.140941619873 s 
====================================================================================================
Epoch 3 Training Performance:{'auc': 0.9128815831150356, 'auc_pr': 0.9047383530006605, 'acc': 0.8246753246753247} in 577.3596904277802 s 
Epoch 3 Validation Performance:{'auc': 0.8960027418110548, 'auc_pr': 0.8732203596229726, 'acc': 0.7014840182648402} in 38.52652382850647 s 
Epoch 3 Better models found w.r.t AUC-PR. Saved it!
Epoch 3 with loss: 0.3729245019287376, best validation AUC-PR: 0.8732203596229726, weight_norm: 11.667880058288574 in 615.931535243988 s 
====================================================================================================
Epoch 4 Training Performance:{'auc': 0.9270629405482578, 'auc_pr': 0.9197291045358151, 'acc': 0.844950967399947} in 696.4409024715424 s 
Epoch 4 Validation Performance:{'auc': 0.9023809709972687, 'auc_pr': 0.8896562828756405, 'acc': 0.718607305936073} in 57.217905044555664 s 
Epoch 4 Better models found w.r.t AUC-PR. Saved it!
Epoch 4 with loss: 0.34243369695998854, best validation AUC-PR: 0.8896562828756405, weight_norm: 10.973993301391602 in 753.7739956378937 s 
====================================================================================================
Epoch 5 Training Performance:{'auc': 0.9341661978279837, 'auc_pr': 0.927173761688685, 'acc': 0.8490591041611449} in 886.5825500488281 s 
Epoch 5 Validation Performance:{'auc': 0.9137437188549028, 'auc_pr': 0.8979809213613976, 'acc': 0.7191780821917808} in 54.920995473861694 s 
Epoch 5 Better models found w.r.t AUC-PR. Saved it!
Epoch 5 with loss: 0.3243825552448378, best validation AUC-PR: 0.8979809213613976, weight_norm: 10.339700698852539 in 941.54958152771 s 
====================================================================================================
Epoch 6 Training Performance:{'auc': 0.9415852933881136, 'auc_pr': 0.9354015341014792, 'acc': 0.8607871720116618} in 884.6150970458984 s 
Epoch 6 Validation Performance:{'auc': 0.9097965013239925, 'auc_pr': 0.8946190974315358, 'acc': 0.7254566210045662} in 53.96951746940613 s 
Epoch 6 with loss: 0.30622637290823257, best validation AUC-PR: 0.8979809213613976, weight_norm: 9.757966041564941 in 938.6192932128906 s 
====================================================================================================
Epoch 7 Training Performance:{'auc': 0.9460718495252268, 'auc_pr': 0.9402837209524766, 'acc': 0.8671481579644845} in 886.5027742385864 s 
Epoch 7 Validation Performance:{'auc': 0.9036059246054086, 'auc_pr': 0.8853706931972677, 'acc': 0.7893835616438356} in 57.20393204689026 s 
Epoch 7 with loss: 0.2941273634590335, best validation AUC-PR: 0.8979809213613976, weight_norm: 9.224824905395508 in 943.751220703125 s 
====================================================================================================
Epoch 8 Training Performance:{'auc': 0.9495459037735796, 'auc_pr': 0.944757091360043, 'acc': 0.8747680890538033} in 881.7859427928925 s 
Epoch 8 Validation Performance:{'auc': 0.9093097777360772, 'auc_pr': 0.8937715782841911, 'acc': 0.7705479452054794} in 53.10473561286926 s 
Epoch 8 with loss: 0.2852121365209252, best validation AUC-PR: 0.8979809213613976, weight_norm: 8.734696388244629 in 934.9430136680603 s 
====================================================================================================
Epoch 9 Training Performance:{'auc': 0.9523159975298425, 'auc_pr': 0.947444435079195, 'acc': 0.877683540948847} in 870.7249267101288 s 
Epoch 9 Validation Performance:{'auc': 0.9073693990950982, 'auc_pr': 0.8947326458468883, 'acc': 0.7602739726027398} in 55.8225040435791 s 
Epoch 9 with loss: 0.2765198019096407, best validation AUC-PR: 0.8979809213613976, weight_norm: 8.286392211914062 in 926.6052746772766 s 
====================================================================================================
Epoch 10 Training Performance:{'auc': 0.9541625744993392, 'auc_pr': 0.9493828020717239, 'acc': 0.8807315133845746} in 879.0248456001282 s 
Epoch 10 Validation Performance:{'auc': 0.9140401836909156, 'auc_pr': 0.8998226003467926, 'acc': 0.7785388127853882} in 54.38370108604431 s 
Epoch 10 Better models found w.r.t AUC-PR. Saved it!
Epoch 10 with loss: 0.2706681700202368, best validation AUC-PR: 0.8998226003467926, weight_norm: 7.872656345367432 in 933.5318131446838 s 
====================================================================================================
